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1.0  Introduction 

The  main  difference  between  a  joint-transform  correlator  (JTC)  and  a  conventional 
Vanderlugt  (4f)  correlator  is  that  the  images  in  the  JTC  are  encoded  in  the  spatial  domain.  In 
terms  of  their  output,  both  types  of  correlators  perform  the  same  operation,  the  cross-correlation 
between  two  images.  In  a  4f  correlator,  the  Fourier  transform  of  an  input  image  is  imaged  onto  the 
Fourier  transform  of  a  reference  image.  In  a  JTC,  both  input  and  reference  images  are  input  simul¬ 
taneously  in  the  spatial  domain,  then  the  Fourier  transform  is  performed.  The  JTC  has  certain 
advantages  when  compared  to  the  4f  correlator  such  as  ease  of  alignment  and  avoiding  spatial  fil¬ 
ter  synthesis.1,2 

Although  most  configurations  of  the  JTC  use  two  input  images,  the  use  of  multiple  input 
images  may  allow  additional  functions  to  be  performed.  For  example,  an  image  and  two  different 
wavelets  were  used  in  a  JTC  for  multispectral  (multiwavelet)  wavelet  feature  extraction  of  the 
image.3  In  this  approach,  different  versions  of  an  input  image  corresponding  to  different  wavelet 
scales  appeared  at  different  locations  in  the  output  plane.  Another  JTC  configuration  used  three 
inputs,  but  required  an  additional  electronic  optical  processing  step  to  implement  the  wavelet 
transform.4  In  addition,  another  approach  used  two  SLMs  with  a  holographic  mask  to  produce  a 
wavelet  -based  JTC.6  Although  the  wavelet  transform  has  provided  an  application  for  a  JTC  with 
multiple  inputs6,  a  generalized  JTC  with  multiple  inputs  may  find  more  applications  including 
those  in  other  areas  if  its  output  function  was  properly  described. 

We  described  a  JTC  that  used  multiple  input  images  encoded  in  the  spatial  domain.  In  the 
next  section  we  briefly  described  the  general  theory  of  a  conventional  JTC,  and  then  extended  the 
discussion  to  multiple  inputs.  Next,  we  provided  some  experimental  results  to  verify  the  results  of 
the  theory.  We  also  described  how  a  multiple-input  JTC  can  be  used  for  multiwavelet  analysis  and 
proposed  an  architecture  that  has  the  same  space-bandwidth  product  as  a  two-input  JTC. 

2.0  Conventional  joint-transform  correlator 

To  perform  the  correlation  operation  with  a  JTC,  functions  are  encoded  in  the  input  plane. 
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A  schematic  diagram  of  a  conventional  JTC  is  shown  in  Fig.  1.  To  perform  the  cross-correlation 
between  the  images  b(x,y )  and  d(x,y),  they  are  centered  at  x  =  ±oc.  A  lens  produces  the  Fourier 
transform  when  the  input  plane  is  illuminated  with  coherent  light.  In  the  Fourier  plane,  the  com¬ 
plex  light  field  is 


U  =  B(p,  q)  e*ap +D  (p,  q)ejap 

) 


(1) 


where  B(p,q)  is  the  Fourier  transform  of  b(x,y),  and  similarly  for  d(x,y).  A  square-law  device  such 
as  a  liquid  crystal  light  valve  is  placed  in  the  Fourier  plane  before  an  another  lens  performs  the 
Fourier  transform.  Alternatively,  a  camera  can  be  used  to  record  the  power  spectrum  and  display 
it  on  a  spatial  light  modulator  (SLM)  before  the  Fourier  transform  is  performed.  The  output  inten¬ 
sity  distribution  from  a  square-law  detector  can  be  written  as 


\u\2  =  UU*  =  [B  (p,  q)  efap  +  D (p,  q)ejap]  [B  (p,q)</ap +D  (p,q)e  jap]* .  (2) 


Multiplying  terms,  taking  the  Fourier  transform,  and  grouping  terms  results  in 


I  =  b(x,y)  ®  b  ( x ,  y )  +  d  (x,  y)  ®d  ( x ,  y )  +  b  (x,  y)  ®  d  (x  +  2a,  y) 

+d(x,y)  ®b  ( x-2a ,  y) ,  (3) 


in  the  output  plane,  where  <S>  indicates  the  correlation  operation.  The  first  two  terms  are  the  auto- 
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correlations  of  the  input  functions  and  appear  on  the  optical  axis.  The  third  and  fourth  terms  are 
the  cross-correlation  between  the  two  input  functions  and  appear  atx  =  ±2<x  shown  in  Fig.  1. 

3.0  Multiple-input  joint  transform  correlator 

We  considered  a  JTC  with  an  arbitrary  number  of  input  images  arranged  along  a  line.  We 

used  the  JTC  as  in  Fig.  1  but  considered  n  inputs  separated  by  a  in  the  input  plane  arranged  along 
the  jt-axis  as  shown  in  Fig.  2.  The  images  were  labeled  aj(x,y)  to  an(x,y),  with  the  center  image 
labeled  as  d(n+i)/2(x>y)-  Using  this  configuration,  the  complex  light  field  in  the  Fourier  plane  was 


U  =  Al(p,q)e 


,,n- lv 

'<-)“P  +  A, 


( P ,  q)  e 


.  ,n- 3. 


..An  +  1  (p,q)  +  ...An(p,  q)e 


.,n~  1. 
-j(— )«p 


(4) 


The  output  intensity  distribution  from  a  square-law  detector  was  written  as  IC/12=  U  x  U  . 
Multiplying  n  x  n  terms,  taking  the  Fourier  transform,  and  grouping  terms  resulted  in  2n  - 1  loca¬ 
tions  in  the  output  plane  where  a  correlation  response  would  occur.  The  output  plane  was 
described  as 


/  = 


X ai(x>y)  ®ai(x,y ) 

Li=l 


n-2 


{ ai  (x,  y)  ®ai+l(x  +  a,y)  +  ^  a{  (x,  y)  ®  ai+  2(x  +  2a,  y) 

i=  1 

n-  (n-1) 

+...  Yj  ai(x>y)  ®  an_1(x+  (n- l)a,y) 

i=  l 

n-2 

(x,  y)  <8>  a i  (x  -  a,  y)  +  Y  ai+2  (x>  y)  ®  ai  (x~2^  y) 

i  =  1 
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(5) 


n-  (n- 1) 

Y  an-\ {x,y)  ®ai(x-(n-\)a.,y) 
i=  1 


The  first  term  in  brackets  in  Eq.  (5)  contains  the  DC  terms  which  is  the  sum  of  the  auto¬ 
correlations  of  all  the  input  images.  The  second  term  in  brackets  correspond  to  n  - 1  terms  to  the 
left  of  the  DC  term  which  are  shown  in  Fig.  3;  each  one  of  these  terms  is  separated  by  a  distance 
a.  The  third  term  is  similar  to  the  second  but  corresponds  to  the  right  of  the  DC  term  in  Fig.  3.  In 
addition,  the  terms  on  each  side  of  the  DC  term  are  the  same  but  rotated  by  tc  radians  as  in  a  con¬ 
ventional  JTC. 

4.0  Experimental  results  with  the  multiple-input  JTC 

We  obtained  experimental  results  to  verify  the  operation  of  a  multiple-input  JTC.  We  used 
a  JTC  with  an  input  displayed  on  film  and  an  optically  addressed  SLM  in  the  Fourier  plane.  We 
used  a  model  SPT-25  optically-addressed  SLM  operating  in  a  transmissive  mode,  manufactured 
by  Micro-Optics  Technologies  Inc.  To  operate  the  device,  light  of  400nm  -  500nm  is  used  as  write 
light  which  is  absorbed  by  a  photosensor  layer.  Light  of  600nm  - 1  lOOnm  is  used  as  the  read  light 
that  carries  the  write-light  information.  A  DC  bias  of  2V  -  15V  is  placed  across  the  device  for 
proper  operation. 

Our  experimental  set-up  is  shown  schematically  in  Fig.  4.  The  Argon  laser  used  a  lOx 
microscope  objective,  25jxm  pinhole  and/=  250  mm  lens  in  the  spatial  filter  assembly.  The  filter 
was  a  narrowband  laser  filter  centered  at  515  nm.  Note  that  this  wavelength  is  outside  of  the  spec¬ 
ification  of  the  SLM,  but  we  obtained  better  results  with  this  line  than  with  the  488nm  line  of  the 
laser.  The  illuminating  light  just  before  the  input  plane  had  a  power  of  4.0  mW  and  both  Fourier 
transform  lenses  had  a  focal  length  of/=  500mm.  The  He-Ne  laser  used  as  the  read  light  of  the 
SLM  used  a  lOx  microscope  objective,  10|im  pinhole  and  /  =  250  mm  lens  in  the  spatial  filter 
assembly.  The  voltage  across  the  SLM  was  12.5V. 
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The  input  plane  consisted  of  four  of  the  same  images  as  shown  in  Fig.  5  where  a  =  1.5mm. 
The  images  were  each  labeled  asf(x,y)  and  substituted  into  Eq.  (5),  and  the  expected  output  plane 
was  described  schematically  as  in  Fig.  6.  The  output  plane  consisted  of  a  bright  spot  on  the  optical 
axis  and  four  responses  on  either  side.  The  responses  located  at  distances  a  and  3a  from  the  opti¬ 
cal  axis  had  the  same  intensity,  as  did  the  responses  located  at  2a  and  4a.  The  responses  at  a  and 
3a  differed  from  those  at  2a  and  4a  by  a  factor  of  two  which  would  correspond  to  a  factor  of  four 
if  the  power  spectrum  was  detected. 

The  experimental  result  corresponding  to  the  left  half  of  Fig.  6  when  Fig.  5  was  used  as  an 
input  is  shown  in  Fig.  7a.  The  optical  axis  corresponding  to  the  center  of  Fig.  6  is  shown  to  the  far 
right  of  Fig.  7a.  Two  bright  spots  along  the  x-axis  corresponded  to  the  autocorrelation  responses 
located  at  distances  a  and  3a  from  the  optical  axis.  Two  additional  autocorrelations  appeared  at  a 
distance  of  2a  and  4a  from  the  optical  axis.  A  profile  plot  along  the  x-axis  through  the  autocorre¬ 
lation  peaks  is  shown  in  Fig.  7b  where  the  peaks  can  be  seen  more  clearly. 

5.0  Multiwavelet  feature  extraction 
5.1  Wavelet  transform 

The  wavelet  transform  has  shown  to  be  useful  in  many  areas  including  that  of  pattern  rec¬ 
ognition.^  The  wavelet  transform  can  be  thought  of  as  a  correlation  between  a  wavelet  and  an 
input  signal.  The  two-dimensional  wavelet  transform  of  an  image  f(x,y)  can  be  written  as 


W  (a,  b)  =  JJ/ (x,  y)  Y*  ab  (x,  y)  dxdy. 


(6) 


where  ^ab(x,y)  is  a  set  of  wavelets  that  are  dilated  and  shifted  versions  of  a  wavelet 
xF('x,yj,  where 
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(7) 


1  x-b  x-b 

vO*?>  =  5t<— V 


). 


where  a  is  a  scale  factor  and  bx  and  by  are  translations  in  the  a:  and  y  directions  respectively.  To 
examine  an  image  at  a  particular  scale  or  frequency  band,  the  image  is  cross-correlated  with  a 
wavelet  at  a  particular  scale. 

To  display  a  version  of  an  input  image  that  corresponds  to  one  wavelet  scale  using  a  JTC, 
one  input  is  the  image  of  interest  and  the  other  is  the  wavelet  function.8  The  resulting  image  then 
appears  at  the  output  of  the  JTC.  Because  wavelets  have  zero  mean,  this  may  present  a  difficulty 
in  the  implementation.  To  remove  the  DC  component  from  the  wavelet  function,  it  was  experi¬ 
mentally  shown  that  the  input  functions  could  be  encoded  in  phase  to  eliminate  the  DC  compo¬ 
nent.3 

5.2  Simulation 

Under  certain  conditions  the  input  arrangement  in  Fig.  2  could  produce  a  version  of  an 
input  image  corresponding  to  multiple  wavelet  scales.  We  considered  an  example  that  produced  a 
version  of  an  input  image  that  corresponded  to  two  wavelet  scales.  In  other  words,  the  output 
image  corresponded  to  the  sum  of  the  cross-correlations  of  the  input  image  and  two  different 
wavelets.  To  perform  this  type  of  operation  we  referred  to  Fig.  2  and  set  n  =  5,  and  a^(x,y)  =  0. 
We  considered  the  input  image  f(x,y)  at  locations  aj(x,y)  and  ct2(x,y),  so  f(x,y)  =  aj(x,y)=  fl2 (x,y). 
Finally,  we  set  a  wavelet  corresponding  to  one  scale  wj(x,y )  =  a^x.y),  and  the  wavelet  at  another 
scale  W2(x,y)  =  a^(x,y)  as  shown  in  Fig.  8. 

The  response  in  the  output  plane  was  obtained  by  substituting  the  appropriate  variables  in 
Eq.  (5),  and  was  represented  schematically  as  shown  in  Fig.  9.  The  third  term  from  the  DC  is  the 
term  of  interest  here.  It  was  the  coherent  sum  of  correlations  of  the  input  image  and  two  different 
wavelets  at  two  different  scales.  To  simulate  the  result  we  used  a  Bessel-Gaussian  wavelet.3  The 
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Bessel-Gaussian  wavelet  was  described  as 


Ja 


Wr~)exp 
Ja  a 


-<555> 


(8) 


where  o' is  related  to  the  width  of  the  bandpass  response,  a  is  the  scale  factor,  and  r  is  the  distance 
from  the  origin. 

We  performed  simulations  with  an  image  of  an  airplane/fxjJ  shown  in  Fig.  10  placed  into 
the  configuration  of  Fig.  8  using  a  total  of  512  x  512  pixels.  The  image  of  the  plane  contained  50 
x  50  pixels  and  a  was  set  to  50  pixels.  The  Bessel-Gaussian  wavelet  was  used  for  wj(x,y)  with  aj 
=  0.7  and  w2(xj)  with  a2  =  1.2.  The  output  plane  was  shown  in  Fig.  11  and  consisted  of  nine 
responses.  The  three  responses  consisting  of  the  one  along  the  optical  axis,  and  the  ones  immedi¬ 
ately  to  the  right  and  left  of  the  optical  axis  at  ±a  were  autocorrelation  responses.  They  all  had 
large  values  and  overlapped  with  each  other.  In  addition,  they  overlapped  the  responses  located 
+2a  from  the  optical  axis.  Therefore,  the  large  spot  in  Fig.  11  consisted  of  five  correlation 
responses.  This  left  four  responses,  two  on  each  side  of  the  large  central  spot.  The  two  remaining 
responses  on  the  left  hand  side  of  Fig.  11  were  expanded  and  shown  in  Fig.  12a.  The  response  on 
the  left  corresponded  to  the  wavelet  with  a2  =  1.2  and  the  one  on  the  right  corresponded  to  the 
sum  of  the  wavelets  with  aj  and  a2.  Changing  aj  to  a2  =  1.0  changed  the  response  on  the  right  but 
not  on  the  left  as  shown  in  Fig.  12b.  A  small  part  of  the  correlation  between  the  image  and  the 

err* 

wavelet  with  associated  with  aj  can  be  seen  in  the  left  side  of  the  image. 

5.3  Implementation 

To  implement  the  multiple-input  JTC  optically  a  few  points  must  be  considered.  One  is 
the  removal  of  the  DC  from  the  wavelet  image.  Wavelets  have  zero  mean,  so  the  wavelet  image 
cannot  be  used  directly.  One  solution  is  to  display  the  wavelet  in  phased  however,  we  proposed  to 
use  a  DC  block  arrangement. 
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Because  more  than  one  scale  of  a  wavelet  is  used  in  our  arrangement,  multiple  wavelet 
images  are  needed;  one  for  each  scale  of  the  wavelet  used.  Displaying  multiple  images  on  an 
SLM  would  increase  the  space-bandwidth  product  of  the  system,  so  we  proposed  to  use  conven¬ 
tional  optics  to  produce  different  versions  of  the  wavelet  at  different  scales.  Similarly  for  copying 
the  input  image. 

A  proposed  multiple-input  JTC  configuration  for  the  multiwavelet  example  was  shown  in 
Fig.  13.  It  used  an  input  SLM  to  display  an  input  image  and  wavelet  image  as  in  a  conventional 
JTC.  The  DC  of  the  wavelet  could  be  eliminated  using  a  DC  block  in  the  Fourier  transform  plane 
of  a  telescope  arrangement.  The  scale  of  a  wavelet  could  be  adjusted  by  varying  the  focal  length 
of  lenses  in  another  telescope  arrangement.  Neutral  density  filters  may  be  used  to  adjust  the 
amplitude  of  the  wavelet.  The  input  lens  in  the  JTC  must  capture  all  images,  but  a  detector  is 
required  for  only  a  portion  of  the  output  plane. 

6.0  Conclusion 

We  showed  how  a  JTC  can  be  used  with  multiple  input  images,  and  how  a  multiple-input 
JTC  can  be  used  for  multiwavelet  analysis  of  an  input  image.  Using  an  image  and  wavelet  as 
inputs,  for  m  wavelet  scales,  m  versions  of  the  wavelet  and  m  copies  of  the  input  image  could  be 
generated  using  conventional  optics.  The  output  consisted  of  Am-l  correlation  results,  one  of 
which  is  the  desired  output.  Using  conventional  optics,  the  space-bandwidth  product  of  the  sys¬ 
tem  can  be  made  the  same  as  for  a  two-input  joint-transform  correlator. 

Because  an  output  image  can  be  produced  that  corresponds  to  multiple  wavelet  scales,  the 
system  is  potentially  more  useful  than  one  that  corresponds  to  a  single  scale.  In  our  demonstration 
the  relationship  between  the  wavelet  scales  was  fixed.  The  relationship  between  the  wavelet 
scales  can  be  made  independent  by  increasing  the  space-bandwidth  of  the  system. 
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FIGURE  1.  Schematic  diagram  of  a  conventional  joint-transform  correlator 
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FIGURE  2.  Input  plane  of  multiple-input  JTC 
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FIGURE  4.  Experimental  set-up  of  multiple  input  JTC 
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FIGURE  5.  Input  image  used  in  experiment 
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FIGURE  6.  Location  and  relative  value  of  correlation  response  of  multiple-input  JTC 
when  Fig.  5  was  used  as  the  input. 
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FIGURE  8.  Input  plane  of  multiwavelet  example 
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FIGURE  9.  Output  plane  of  multiwavelet  example 
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FIGURE  10.  Image  used  in  simulation  experiments. 
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FIGURE  11.  Output  plane  of  multiwavelet  simulation  experiment. 
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FIGURE  12.  Close-up  view  of  left  hand  side  of  Fig.  11.  Response  on  left  in  both  cases  is  for 
a2= 1.2,  (a)  response  of  right  is  for  a2  +  a2,  where  aj  =  0.7  (b)  response  of  right  is  for  aj+a2,  where 
a  i  =  1.0. 
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FIGURE  13.  Schematic  diagram  of  multiple-input  JTC  used  for  multiwavelet  analysis 
using  two  wavelet  scales 
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OF 

ROME  LAB  ORA  TOR  Y 


Mission.  The  mission  of  Rome  Laboratory  is  to  advance  the  science  and 
technologies  of  command,  control,  communications  and  intelligence  and  to 
transition  them  into  systems  to  meet  customer  needs.  To  achieve  this, 
Rome  Lab: 

a.  Conducts  vigorous  research,  development  and  test  programs  in  all 
applicable  technologies; 

b.  Transitions  technology  to  current  and  future  systems  to  improve 
operational  capability,  readiness,  and  supportability; 

c.  Provides  a  full  range  of  technical  support  to  Air  Force  Material 
Command  product  centers  and  other  Air  Force  organizations; 

d.  Promotes  transfer  of  technology  to  the  private  sector; 

e.  Maintains  leading  edge  technological  expertise  in  the  areas  of 
surveillance,  communications,  command  and  control,  intelligence, 
reliability  science,  electro-magnetic  technology,  photonics,  signal 
processing,  and  computational  science. 

The  thrust  areas  of  technical  competence  include:  Surveillance, 
Communications,  Command  and  Control,  Intelligence,  Signal  Processing, 
Computer  Science  and  Technology,  Electromagnetic  Technology, 
Photonics  and  Reliability  Sciences. 


